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In  an  Interesting  paper  Bedroslan  has  Introduced  the 
concept  of  weighted  pulse-code  modulation,  WPCM.  This  differs 
from  normal  PCM  In  that  the  amplitude  of  the  transmitted  pulses 
representing  the  ^  Inary  digits  In  a  pulse— code  group  are  made 
to  depend  on  the  size  of  the  group  and  on  the  power  of  two 
represented  by  the  Individual  pulses.  In  general,  the  higher 
the  power  of  two  represented  by  the  pulse,  the  larger  the 
amplitude  of  the  pulse. 

In  this  paper  It  la  shown  how  the  functional  equation 
technique  of  dynamic  programming  can  he  used  advantageously 
in  the  analysis  of  WPCM  communication  systems. 
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ON  WEIGHTED  PCM  AND  MEAN  SQUARE  DEVIATION 

Richard  Bellman 
RoVert  Kalaba 

In  an  Interesting  paper  Bedroslan  has  Introduced  the  con¬ 
cept  of  weighted  pulse— code  modulation,  WPCM,  [l] .  This 
differs  from  normal  PCM  In  that  the  amplitude  cf  the  trans¬ 
mitted  pulses  representing  the  binary  digits  In  a  pulse— code 
group  are  made  to  depend  on  the  size  of  the  group  and  on  the 
power  of  two  represented  by  the  Individual  pulses.  In  general, 
the  higher  the  power  of  two  represented  by  the  pulse,  the 
larger  the  amplitude  of  the  pulse.  A  comparison  between  PCM 
and  WPCM  system  performances,  Indicating  the  advantages  of 
WCPM,  can  be  found  In  Bedroslan 's  paper. 

1.  The  analysis  of  a  WPCM  system  Involves  the  determlna— 

f 

tlon  of  the  optimal  power  to  be  allocated  to  the  transmission 
of  each  binary  digit,  under  the  assumption  of  a  fixed  power  per 
pulse— code  group,  to  minimize  the  mean  square  deviation  of  the 
reconstructed  signal  at  the  receiver  from  the  signal  sampl- 
value  presented  by  the  Information  source.  If  tiiere  are  N 
digits  per  pulse— code  group,  then  use  of  the  Lagrange  multi¬ 
plier  method  Involves  the  solution  of  a  system  of  N  +  1 
simultaneous  trainscendental  equations.  Bedroslan  accomplishes 
this  under  tiie  assumption  that  the  avereige  signal  power  avail¬ 
able  is  sufficiently  great  to  make  the  occurrence  of  more  than 
one  error  per  pulse— code  group  almost  zero.  This  assumption 


P-1 22^ 
12-2-57 

-2- 


leads  to  a  system  of  N  +  1  Independent  equations  for  the 
power  allocations  and  the  Lagrange  multiplier. 

In  addition,  he  assumes  that  tlie  probability  of  a  digit's 
being  received  Incorrectly  as  a  function  of  signal  strengtbi, 
and  the  derivative  of  this  function,  are  both  simply  express¬ 
ible  In  terms  of  the  error  function.  Tl-ls  may  lead  to 
difficulties  In  locating  the  extrema  since  tbie  smoothed  Curve 
I,  In  the  figure  below,  may  be  a  reasonable  approximation  to 
Curve  II,  without  tbie  slope  of  I  at  a  point  necessarily  being 
a  reasonable  approximation  t^  the  slope  of  II  at  the  same 
point . 


2.  We  wlsbi  to  present  an  alternative  approach  to  the 
analysis,  cased  on  tbie  functional  equation  technique  of  dynamic 
programming,  [2j  ,  In  whlcb^  no  assumption  of  smallness  Is 
necessary  concerning  the  probability  of  error;  tbils  Is  slgnl— 
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f leant,  for  a  WPCM  system  may  function  satisfactorily  with 
signal  power  so  low  that  several  errors  per  pulse— group  occur, 
the  errors  being  localized  to  the  coefficients  of  the  lower 
powers  of  two,  which  Is  manifestly  not  possible  with  ordinary 
PCM.  In  addition,  minima  are  determined  without  the  use  of 
partial  derivatives.  This  permits  the  probability  of  error  to 
be  given  as  a  function  of  signal  strength  either  graphically 
or  In  tabular  form,  baaed  upon  experimental  results,  and  not 
necessarily  In  analytic  form.  Lastly,  the  quantization  noise 
Is  handled  In  a  particularly  simple  and  straightforward  fashion. 

3.  Let  us  consider  that  each  pulse— code  group  consists 
of  N  binary  digits  and  that  the  power  P  Is  available  for 
sending  the  entire  group.  The  probability  of  the  correct 
reception  of  a  digit  If  the  transmitted  power  Is  p  Is  defined 
to  be  g(p).  We  assume  that  transmission  and  reception  of  the 
Individual  digits  are  Independent.  We  wish  to  determine  the 
power  Pj^  to  allocate  to  the  transmission  of  the  coefficient 
of  the  1— th  power  of  two  which  results  In  minimizing  the  mean 
square  deviation  of  the  received  signal  from  the  signal  sample 
value  provided  by  the  source  of  Information,  where 
N-1 

(5.1)  2  Pi  - 
1-0  ^ 

(3.2)  0  <  Pi»  1-1,2,.... 

We  assume  that  the  transmitter  will  transmit  a  'one'  as  the 
coefficient  of  If  a  >  2^^,  where  a  Is  the  signal 
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sample  value,  and  a  'zero'  otherwise;  call  this 

coefficient  .  It  transmits  a  'one'  as  the  coefficient  of 

VI  o  _ -1  M  n 

2  If  a  -  2  >2  ,  and  a  'zero'  otherwise,  and 

so  on . 

TVie  reconstrnic ted  received  signal  will  be 


(3.5) 


8  -  2^^  X  +  2^^  X  -f 

®N-1  ^  ^N-1  ^N-2 


oN-1 

2  9n_2» 


+  2^  X. 


where  x^  la  a  random  variable  assuming  only  the  values  zero 
or  one.  Since  the  probability  of  a  correct  transmission  of  the 
k— th  digit  with  power  p^  la  g(p^),  we  have 

(?.<*)  Pr  {\  ■  ■  8(Pk)- 

The  mean  square  deviation  of  the  received  signal  from  the 
signal  sample  value,  a.  Is 

E((a  -  8,^1  )2j  .  E{(a  - 

(?-5)  . 

-  2  [a  -  *  E(a^2j 

By  completing  the  square  this  Ircomes 


I 


P-122  :> 
12-2-57 


To  transform  the  minimization  problem  Into  one  Involving 
functional  equations  we  Introduce  the  function 

■  the  expected  value  of  the  square  deviation 
of  the  received  signal  from  the  source 
signal,  a,  using  an  optimal  allocation 
of  the  power  P  to  the  Individual  digits, 
each  pulse— code  group  consisting  of  N 
digits. 

s 

By  definition,  then, 

(3.7)  Min  Ef(a  -  s„  ,  )^|  - 

N  ^  I  N 


where  the  minimization  la  over  the  set  of  p^  defined  by 


(5.8) 


0  <  p^,  1  -  0,  1, 


N-1 

2p- 

1-0  ' 


p. 


N-1, 


If  we  wish  to  Include  the  effect  of  a  limitation  on  peak 
power,  Ppi^»  addition  Impose  the  condition  that 

0  <  Pj^  <  Ppj^ .  This  would  be  difficult  to  Incorporate  In  the 
Lagrange  multiplier  scheme. 

If  we  now  use  the  principle  of  optimality,  [2]  ,  and 
Eq  .  ( 3 . h ) ,  we  o\  tain 
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f  (a,P)  -  Min  (var(a  -  J 


(3.9) 


N  -  2,  3,  ...  . 


If  t^'.e  pulse— code  group  consists  of  just  one  Unary  digit,  all 
available  power  Is  used  and  we  obtain 


(J.IO) 


fl(a,P) 


g(P)a^  +  (l-g(P))(l-a)^, 
g(P)(l-a)^  +  (l-r(P))a^, 


0  <  a  <  1, 

1  <  a  <  00  . 


Ttius  the  multidimensional  optimization  prol  lem  Is  converted 
Into  a  sequence  of  one-dlmenslonal  optimization  problems. 


4.  Using  the  last  two  equations  we  are  able  to  compute 
recursively,  using  a  high-speed  digital  computer,  the  sequence 

(a,P)j  and  the  power 
allocations,  p^ ,  as  functions  of  k,  r,  and  P.  Tills 
computation  Is  stralglitforward  on  a  digital  computer  and  Is 
simplified  1.  y  th.e  fact  that  If  fj^(a,P)  Is  to  be  determined 
for  a  and  P  in  a  certain  domain  0  <  ®  ^  ^  £  ^0* 

then  all  the  f^(a,P)  for  k  <  N  need  only  be  determined  In 
sub— domains ,  as  we  see  upon'' referring  to  Eq.  (3.9). 


of  functions  of  two  variables 


5.  Note  that  the  transmitter  Is  not  provided  with  a 
feedback  link  which  gives  It  Information  concerning  whetrier  or 
not  the  previous  signal  was  corr  ly  received,  so  that  the 
exact  stEte  of  the  system  Is  not  known  at  the  transmitter  at 
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each  stage.  Nonetheless,  the  transmitter  Is  able  to  transmit 
optimally  with  regard  to  the  least  mean  square  deviation 
criterion  by  proceeding  as  If  the  signal  a  had  been  changed 
purely  deterministically  to  a  -  . 

Tills  observation  should  find  application  In  other 
situations  Involving  least  mean  square  error  criteria.  It 
means  that  In  some  situations  we  can  associate  an  equivalent 
deterministic  process  with  a  stochastic  process. 

6.  The  problems  Involved  In  optimizing  the  performance 
of  null-zone  reception  systems  and  null— zone  reception 
systems  provided  with  feedback  channels,  [5],  can  be  treated 
similarly,  by  use  of  the  functional  equation  technique.  Tt 
would  be  of  Interest  to  evaluate  the  performance  of  communi¬ 
cation  systems  employing  combinations  of  WPCM,  null— zero 
reception,  and  feedback  channels. 
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